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DETAILED ACTION 

Continued Examination Under 37 CFR LI 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
ehgible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. Apphcant's submission filed on December 12, 2007 has been entered. 

Response to Arguments 

2. Applicant's arguments filed December 12, 2007 have been fiiUy considered but they are 
not persuasive. 

3. Applicant argues, "in the cited reference Soshi, an aperture value in which two objects in 
a field fall within a depth of field is obtained by calculation based on the object distances. 
Therefore, in the cited reference Soshi, the object distance is actually measured at the timing of 
shooting and the aperture value is calculated by using the actually measured object distance and 
the object brightness. Therefore, in the cited reference Soshi, the object distance is not estimated 
fi-om the object brightness by using a database." 

4. The Examiner respectfiiUy disagrees with Applicant's position. In Soshi, as shown in 
figure 2, a database is formed as a result of step S53 and step S57. Since an object distance and 
object luminance is measured for every object in the scene (see column 4, lines 17 - 66), the 
memory represents a database formed by statistically processing information obtained firom a 
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plurality of past photographing operations (The measurements are related to the actual taking of 
a picture; hence, the measurements would be photographing operations. Moreover, the 
measurements are obtained well in advance of the actual taking of the picture; hence, the 
measurements are past photographing operations. Since the actual type statistical processing is 
not specified, the mere fact that they are organized in a memory would quality as statistically 
processing.). Finally, for the actual taking of the picture, an optimum aperture value is estimated 
(see step S63) based on the stored object distance and brightness information (which is prepared 
of step S63). The estimated optimum aperture value would represent an object distance common 
to the plurality of objects in the scene such that each object would be in focus. Therefore, an 
object distance is selected having the highest photographing frequency (see colunm 5, lines 6 - 
38) among object distances corresponding to the acquired object brightness values. 

5. For these reasons, the rejection will be maintained. 

Claim Rejections - 35 USC §102 

6. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

7. Claims 1 - 3, 7 - 9, 13 14, 28, and 29 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Soshi (US 5,400,1 10). 



Application/Control Number: Page 4 

10/681,694 

Art Unit: 2622 

The Examiner respectfully notes Claim 1-3 and Claims 7-9 appear to be 
corresponding apparatus and method claims, respectively. Accordingly, they will be rejected 
together. 

8. For Claims 1 and 7, Soshi discloses an image sensing apparatus comprising: 

a memory (column 3, line 47 memory) which stores a database which is prepared in 
advance (i.e., just before step S63) by statistically processing information obtained from a 
plurality of past photographing operations (The measurements are related to the actual taking of 
a picture; hence, the measurements would be photographing operations. Moreover, the 
measurements are obtained well in advance of the actual taking of the picture; hence, the 
measurements are past photographing operations. Since the actual type statistical processing is 
not specified, the mere fact that they are organized in a memory would quality as statistically 
processing.), and represents a relationship between a photographing frequency (see colunrn 4, 
lines 21 - 25), object distance, and object brightness (object brightness and distance are stored 
each different object captured; see column 4, lines 17 - 66); 

an acquisition device (figure 1, photometering sensor 26) which acquires an object 
brightness value (column 5, lines 1-10, noted that it detects the luminance of the object) on the 
basis of image information sensed by an image sensing device (photometering sensor is an image 
sensing device); and 

a control device (figure 1, control circuit 24) which refers to that database stored in said 
memory to select an object distance having the highest photographing frequency ("optimum 
depth of field"; see column 6, lines 5 - 10) among object distances ("two object distances Dl and 
D2"; see column 4, lines 21 and 25) corresponding to the acquired brightness value (see column 
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5, lines 6 - 20), and controls image sensing operation on the basis of the detected object distance 
information (see column 6, lines 5-10 and 30 - 39). 

According to Soshi (see column 5, lines 1 - 20), a plurality of object distances and 
brightness information are stored for a plurality of subjects. The control device then refers to the 
stored information to determine and optimum depth of field among the plurality of objects. The 
Examiner considers the optimum depth of field to directly correspond to the highest 
photographing fi-equency. Soshi then controls the image sensing operations based upon the 
stored data and the determination (see column 5, lines 21-40 and column 6, lines 5-39). 

In summary, for the actual taking of the picture, an optimum aperture value is estimated 
(see step S63) based on the stored object distance and brightness information (which is prepared 
of step S63). The estimated optimum aperture value would represent an object distance common 
to the plurality of objects in the scene such that each object would be in focus. Therefore, an 
object distance is selected having the highest photographing fi-equency (see column 5, lines 6 - 

V 

38) among object distances corresponding to the.acquired object brightness values. 
9. As for Claims 2 and 8, Soshi discloses wherein said control device (fig, 1 control circuit 
24) sets a scanning range (col. 4, lines 59-62, noted the object distance data Dl and D2 measured 
by detecting means 14) of a focus adjustment lens for determining an in- focus position by 
limiting the scanning range (coL 4, lines 59-62, noted the object distance data Dl and D2 
measured by detecting means 14) to a predetermined range including a selected object distance, 
and determines an in-focus position (col. 5, lines 6-1 1, noted that the desired object distance is 
obtained based on the data stored in memory). 
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10. As for Claims 3 and 9, Soshi discloses wherein when no in-focus position (col. 5, lines 
11-12, noted that object distance Dl and D2 are not within the depth field) can be determined, 
said control device drives and controls the focus adjustment lens to a position corresponding to 
the selected object distance (col. 5 line 67 to col. 6 line 4, noted that control circuit operates to 
make the two object distances fall within the range). 

11. As for Claims 28 and 29, According to Soshi (see column 5, lines 1 - 20), a plurality of 
object distances and brightness information are stored for a plurality of subjects. The control 
device then refers to the stored information to determine and optimum depth of field among the 
plurality of objects. The Examiner considers the optimum depth of field to directly correspond 
to the highest photographing firequency. Soshi then controls the image sensing operations based 
upon the stored data and the determination (see column 5, lines 21 - 40 and column 6, lines 5 - 
39). In summary, for the actual taking of the picture, an optimum aperture value is estimated 
(see step S63) based on the stored object distance and brightness information (which is prepared 
of step S63). The estimated optimum aperture value would represent an object distance common 
to the plurality of objects in the scene such that each object would be in focus. Therefore, an 
object distance is selected having the highest photographing fi-equency (see column 5, lines 6 - 
38) among object distances corresponding to the acquired object brightness values. 

12. For Claim 14, Soshi discloses an image sensing apparatus comprising: 

a memory (column 3, line 47 memory) which stores a database which is prepared in 
advance (i.e., just before step 863) by statistically processing information obtained fi-om a 
plurality of past photographing operations (The measurements are related to the actual taking of 
a picture; hence, the measurements would be photographing operations. Moreover, the 
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measurements are obtained well in advance of the actual taking of the picture; hence, the 
measurements are past photographing operations. Since the actual type statistical processing is 
not specified, the mere fact that they are organized in a memory would quality as statistically 
processing.), and represents a relationship between a photographing frequency (see column 4, 
lines 21 - 25), object distance, and object brightness (object brightness and distance are stored 
each different object captured; see column 4, lines 17 - 66); 

an acquisition device (figure 1, photometering sensor 26) which acquires an object 
brightness value (column 5, lines 1-10, noted that it detects the luminance of the object) on the 
basis of image information sensed by an image sensing device (photometering sensor is an image 
sensing device); and 

a control device (figure 1, control circuit 24) which refers to that database stored in said 
memory to select an object distance having the highest photographing frequency ("optimum 
depth of field''; see column 6, lines 5-10) among object distances ("two object distances Dl and 
D2"; see column 4, lines 21 and 25) corresponding to the acquired brightness value (see column 
5, lines 6 - 20), and controls image sensing operation on the basis of the detected object distance 
information (see colxmm 6, lines 5-10 and 30 - 39). 

According to Soshi (see column 5, lines 1 - 20), a plurality of object distances and 
brightness information are stored for a plurality of subjects. The control device then refers to the 
stored information to determine and optimum depth of field among the plurality of objects. The 
Examiner considers the optimum depth of field to directly correspond to the highest 
photographing frequency. Soshi then controls the image sensing operations based upon the 
stored data and the determination (see column 5, lines 21-40 and column 6, lines 5 - 39). 
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In summary, for the actual taking of the picture, an optimum aperture value is estimated 
(see step S63) based on the stored object distance and brightness information (which is prepared 
of step S63). The estimated optimum aperture value would represent an object distance common 
to the plurality of objects in the scene such that each object would be in focus. Therefore, an 
object distance is selected having the highest photographing frequency (see column 5, lines 6 - 
38) among object distances corresponding to the acquired object brightness values. 

Finally, Soshi additionally discloses a computer readable storage medium which stores a 
program for realizing the image sensing apparatus and corresponding method (see column 3, 
lines 44 -47). 

Claim Rejections - 35 USC § 103 

13. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

14. Claims 4-6 and 10 - 12 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Soshi (US 5,400,1 10) in view of Takahashi (US 7,009,641 B2). 

The Examiner respectfully notes Claim 4-6 and Claims 10-12 appear to be 
corresponding apparatus and method claims, respectively. Accordingly, they will be rejected 
together. 
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15. As for Claims 4 and 10, Soshi teaches wherein when an object distance corresponding to 
an in- focus position is not more than thresholds (column 5, lines 11-12, noted that the object 
distance Dl and D2 is not within tile depth of field). 

However, Soshi does not specifically teach about an indoor photography operation. 

In an analogous art, Takahashi teaches the acquired brightness value (col 15, lines 13-14, 
subject brightness) is not more than thresholds (fig. 13, step S503 and col. 15, lines 13-16, noted 
that the subject brightness is compared with a predetermined value whether it is equal or lower) 
and control device (fig. 2, CPU 21) controls the image sensing operation to indoor (fig. 13, 
operations firom S503- S504, col. 15, lines 16-20, noted that the indoor photographing operation 
is determined) image sensing operation. 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of the invention to modify the device of Soshi by incorporating the method as taught by 
Takahashi in order to intelligently riecognize whether the scene requires indoor or outdoor image 
sensing mode (fig. 13, steps S503, S504 and S507, noted that the step S503 determines whether 
the scene is indoor or outdoor based on the brightness value captured). 

16. As for Claims 5 and 11, Soshi teaches all claimed limitation with the exception wherein 
as the indoor image sensing operation, an emission amount of test emission of emitting light in 
advance in order to set an emission amount of an illumination device for illuminating an object is 
set smaller than an outdoor emission amount. 

In an analogous art, Takahashi wherein as the indoor image sensing operation (fig. 13, 
indoor operations fi"om S503-S504), an emission amount of test emission of emitting light (fig. 
13, step S504 and col. 15, lines 20-23, noted that the fluorescent light is determined) in advance 
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in order to set an iemission amount of an illumination device for illuminating an object is set 
smaller (since indoor scene is brighter with fluorescent light, thus it is set smaller than outdoor 
image sensing) than an outdoor emission amount. 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of the invention to modify the device of Soshi by incorporating the method of determining the 
light emission as taught by Takahashi in order to determine whether fluorescent hght is needed 
for different photographing scene (fig. 13, steps S503, S504 and S507 and col. 15, lines 20-28). 
17. As for Claims 6 and 12, Soshi teaches all claimed limitation with the exception of 
wherein as the indoor image sensing operation, an extraction range for extracting white image 
information fi-om the image information sensed by the image sensing device in order to adjust 
white balance is made by said control device to differ from an outdoor extraction range. 

In an analogous art, Takahashi teaches wherein as the indoor image sensing operation 
(fig. 13, indoor operations fi-om S503-S504), an extraction range for extracting white image 
information (col. 15, lines 44-49, noted that the white balance gains are dqtermined) firom the 
image information (col. 15, lines 45, color temperature) sensed by the image sensing device (fig. 
2, image capturing element 26) in order to adjust (col. 15, lines 44-49, noted that the white 
' balance adjustment gain values are used to adjust the white balance) white balance is made by 
said control device to differ (col. 16, lines 2-8, noted that white balance adjustment gain values 
are determined based on the different color temperature, since indoor and outdoor extraction 
range are different, the white balance adjustment gain values are also computed differently) fi-om 
an outdoor extraction range. 
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Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of the invention modify the device of Soshi by incorporating the method of extracting the white 
image information as taught by Takahashi in order to adjust the white balance in conformance to 
the level of the brightness of the object (col. 14, lines 38-44). 

Cited Prior Art 

1 8. The prior art made of record and not relied upon is considered pertinent to Applicant's 
disclosure for the following reasons: 

Each of the cited references disclose a camera having a learning function, where the 
camera performs future camera operations based upon analyzing the camera and pictures during 
past camera operations. 

Conclusion 

19. Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Justin P Misleh whose telephone number is 571.272.7313. The 
Examiner can normally be reached on Monday through Friday from 8:00 AM to 5:00 PM. 

If attempts to reach the Examiner by telephone are imsuccessful, the Examiner's 
supervisor, Lin Ye can be reached on 571.272.7372. The fax phone number for the organization 
where this appHcation or proceeding is assigned is 571.273.8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
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applications is available through Private PAIR only. For more information about the PAIR ' 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Justin P. Misleh/ 
Examiner, GAU 2622 
February 11, 2008 



